Information States in a Multi - modal DialogueSystem for Human - Robot
نویسندگان
چکیده
We discuss the dialogue modelling techniques in the ongoing development of a dialogue system for multi-modal conversations with autonomous mobile robots. The dialogue system is implemented using Nuance, Gemini, and Festival language technologies under the Open Agent Architecture. This paper focusses on our general-purpose dialogue manager which implements a dynamic information state model of dialogue.
منابع مشابه
Hybridization of Facial Features and Use of Multi Modal Information for 3D Face Recognition
Despite of achieving good performance in controlled environment, the conventional 3D face recognition systems still encounter problems in handling the large variations in lighting conditions, facial expression and head pose The humans use the hybrid approach to recognize faces and therefore in this proposed method the human face recognition ability is incorporated by combining global and local ...
متن کاملA computational model of multi-modal grounding for human robot interaction
Dialog systems for mobile robots operating in the real world should enable mixedinitiative dialog style, handle multi-modal information involved in the communication and be relatively independent of the domain knowledge. Most dialog systems developed for mobile robots today, however, are often system-oriented and have limited capabilities. We present an agentbased dialog model that are speciall...
متن کاملMulti-person conversation via multi-modal interface - a robot who communicate with multi-user -
This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional oneto-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking / appealing to whom the system is speaking), space information sharing problem and turn hol...
متن کاملNavigation of a Mobile Robot Using Virtual Potential Field and Artificial Neural Network
Mobile robot navigation is one of the basic problems in robotics. In this paper, a new approach is proposed for autonomous mobile robot navigation in an unknown environment. The proposed approach is based on learning virtual parallel paths that propel the mobile robot toward the track using a multi-layer, feed-forward neural network. For training, a human operator navigates the mobile robot in ...
متن کاملA Multi-modal Teaching-Advisory System using Complementary Operator and Sensor Information - Robot and Human Communication, 1995. RO-MAN'95 TOKYO, Proceedings., 4th IEEE International Worksho
A multi-modal teaching-advisory system for sensor-based robot systems is presented that uses complementary information obtained from the operator and sensors. W e propose a new framework for on-site robot teaching systems that takes account of the characteristics of humans and sensors. This framework enables the teaching system to integrate a variety of robot task constraints, task specificatio...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001